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Abstract 

Nondominated sorting is a combinatorial algorithm that sorts points in Euclidean 
space into layers according to a partial order. It was recently shown that nondominated 
sorting of random points has a Hamilton-Jacobi equation continuum limit. The original 
proof, given in HB, relies on a continuum variational problem. In this paper, we give 
a new proof using a direct verification argument that completely avoids the variational 
interpretation. We believe this proof is new in the homogenization literature, and may be 
generalized to apply to other stochastic homogenization problems for which there is no 
obvious underlying variational principle. 


1 Introduction 

Many problems in science and engineering require the sorting, or ordering, of large amounts 
of multivariate data. Since there is no canonical linear criterion for sorting data in dimensions 
greater than one, many different methods for sorting have been proposed to address various 
problems (see, e.g., [zmaiiiiisi]). Many of these algorithms abandon the idea of a linear 
ordering, and instead sort the data into layers according to some set of criteria. 

We consider here nondominated sorting, which arranges a set of points in Euclidean space 
into layers by repeatedly removing the set of minimal elements. Let A denote the coordinate- 
wise partial order on dehned by 

X S y Xi < yi for all i. 

The first nondominated layer, also called the first Pareto front and denoted Jq, is exactly the 
set of minimal elements of S with respect to A, and the deeper fronts are defined recursively 
as follows: 

Tk = Minimal elements of S' \ 

i<k 

This peeling process eventually exhausts the entire set S, and the result is a partition of S 
based on Pareto front index, which is often called Pareto depth or rank. Figure [T] gives an 
illustration of nondominated sorting of a random set S. 

*The research described in this paper was partially supported by NSF grant DMS-1500829. 
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(a) i.i.d. samples 


(b) n = 10^ points 


(c) n = 10® points 


Figure 1: Examples of Pareto fronts corresponding to i.i.d. random variables Xi,... drawn 
from the distribution depicted in (a). In (b) and (c), we show 30 evenly spaced Pareto fronts 
for n = 10 ^ and n = 10 ®, respectively. 


Nondominated sorting is widely used in multi-objective optimization, where it is the basis 
of the popular and effective genetic and evolutionary algorithms [141I151I201I211I57) . Of course, 
multi-objective optimization is ubiquitous in engineering and scientific contexts, such as con¬ 
trol theory and path planning |40ll46llT7] . gene selection and ranking [IIHl9l[27H29l[56], data 
clustering |26) . database systems |30ll37ll4^ . image processing and computer vision [131148) . 
and some recent machine learning problems |30H32) . 

Nondominated sorting is also equivalent to the longest chain problem, which has a long 
history in probability and combinatorics |9l[T6l[25l|6n|. A chain in is a finite sequence of 
points that is totally ordered with respect to Let Xi,... ,Xn be n distinct points in 
and define 

Un{x) = e{{Xi,...,Xn}n[o,x]), (1.1) 

where i{0) denotes the length of a longest chain in the finite set O C M'^. The notation [0, x] 
is a special case of the more general interval notation 


d 

[x, ^;] = {y G : x ^ y ^ z} = JJ[xi, Zi] 

i=l 

that we shall use throughout the paper. Let J^i, 7 ^ 2 ;-F 3 ,... denote the Pareto fronts obtained 
by applying nondominated sorting to S := {Xi ,..., X„}. Then x G if and only if there are 
no other points y G 5 with y ^ x, i.e., Unix) = 1. A point x G S' is on the second Pareto front 
J -2 if and only if all points y G S satisfying y ^ x are on the first front, and one such point 
exists. For any such y G {y,x} is a chain of length .^ = 2 in S PI [0, x], and we see that 
X G Unix) = 2. Peeling off successive Pareto fronts and repeating this argument 

yields 

x e Xk Unix) = k. 

Hence, the Pareto fronts J^i, J- 2 )-F 3 ,... are embedded into the level sets (or jump sets) of the 
longest chain function Un, as depicted in Figured) 

In m, we proved the following continuum limit for nondominated sorting. 

Theorem 1. Let Xi,X 2 ,X‘^,... be a sequence of i.i.d. random variables in with density 
f, and define Un by on]). Suppose there exists an open and bounded set O C R^j. with 
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Lipschitz boundary such that f is uniformly continuous on O, and f{x) = 0 for x ^ O. Then 
n~dUn —^ u uniformly on [0, oo)'^ with probability one, where u is the unique nondecreasin^ 
viscosity solution of the Hamilton-Jacobi equation 


(P) 


u. 


■Uxa = (cd/dff 


u = 0 


in 

on 


and Cd > 0 are the universal constants given in m- 

This result shows that nondominated sorting of massive datasets, which are common in 
big data applications can be approximated by solving a partial differential equation 

(PDE). In |12| . we exploited this idea to propose a fast approximate nondominated sorting 
algorithm based on estimating / from the data Xi,... ,Xn and solving (P) numerically. 

The proof of Theorem [H given in im, is based on the following continuum variational 
problem: 

u{x) = cdsup[ /(7(t))3(7j(t)---7^(t))3dt, (1.2) 

Jo 

where the supremum is over all curves 7 : [ 0 , 1 ] —?> [ 0 , 00 )'^ that are monotone nondecreasing 
in all coordinates and satisfy 7 ( 1 ) = x. This can be viewed as a type of stochastic homogeniza¬ 
tion of the longest chain problem, where the curves 7 are continuum versions of chains. The 
variational problem (11.21) first appeared in two dimensions in |16| . The PDE (P) arises as the 
Hamilton-Jacobi-Bellman equation associated with o m We used the same ideas to prove 
a similar Hamilton-Jacobi equation continuum limit for the directed last passage percolation 
model in statistical physics, which also has an obvious discrete variational formulation | 10 ) . 

It is possible to view Theorem [T] in the context of stochastic homogenization of Hamilton- 
Jacobi equations. Indeed, Un can be interpreted as a discontinuous viscosity solution of the 
Hamilton-Jacobi equation 

n v 

Un,xi ■ ■ ■ ^ ^ dXi in 

i=l ( 1 - 3 ) 

Un = ^ on dW^., 

Since the right hand side of (II. is highly singular, it is worth discussing in what sense we 
interpret Un to be a solution of (11.31) . The obvious approach is to mollify the right hand 
side to obtain a sequence of approximate solutions. It is possible so show that as e ^ 0, 
the sequence Uf converges pointwise to CUn, where the constant C > 0 depends on the 
mollification kernel used. Intriguing as this observation is, it is unclear whether (II.3j) can be 
used directly to prove Theorem [TJ 

There is a growing literature on stochastic homogenization of Hamilton-Jacobi equations. 
Many of the proofs are based on applying subadditive ergodic theory to a representation 
formula for the solution, like the Hopf-Lax formula, or more generally, a control theoretic 
interpretation |38 ( I39 ( IT H I42 ([5T11531I55) . These techniques are similar in spirit to our original 
proof of Theorem [1] that was based on the variational representation of u given in (II.2p . 
Recently, there has been significant interest in stochastic homogenization techniques that do 
not require a variational interpretation [Tl-[3l l43ll^ . 

^We say u is nondecreasing if Xi 1 -^ u{x) is nondecreasing for all i. 
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In this paper we give an alternative proof of Theorem [T] that uses a direct verihcation 
argument, and completely avoids using the variational interpretation of (P). The argument is 
based on a heuristic derivation of (P) that originally appeared in |11| . We review this argument, 
which is reminiscent of dimensional analysis, in Section [2. II We believe this proof is new in the 
stochastic homogenization literature, and it seems to be more robust than arguments based on 
variational principles. We present the proof in the simplest setting in this paper, but we believe 
it can be substantially generalized. In future work, we plan to apply this proof technique to 
other stochastic growth models that do not stem from underlying variational principles. 

2 Main result 

To simplify the presentation, we model the data here using a Poisson point process. Given a 
nonnegative function / G we denote by IIj a Poisson point process with intensity 

function /. This means that Uf is a random at most countable subset of and for every 
bounded Borel set A C the cardinality of IIj n denoted N{A), is a Poisson random 
variable with mean f dx. Furthermore, for disjoint A and B, the random variables N{A) and 
N{B) are independent. It is worthwhile to mention that in the special case where f dx = 1, 
one way to construct Ilnf for any n > 0 is by setting 

Hr,./:= {Xi,..., Xat}, (2.1) 

where Xi, X 2 , X^,... is an i.i.d. sequence of random variables with density / and is a 
Poisson random variable with mean n. For more details on Poisson point processes, we refer 
the reader to Kingman’s book [36]. 

Set 

B = ^ [0, 00) : / is locally bounded and Lebesgue measurable. |. 

For / G X G and n G N we define 

Unix) = i(n.nf ri[0,x]) . (2.2) 

In this paper, we give a direct verification argument proof of the following result. 

Theorem 2. Let f £ B such that (P) has a unique nondecreasing viscosity solution u. Then 
with probability one 

n~dUn —> u locally uniformly on [0,oo)'’*. 

In im, we showed that there exists a unique nondecreasing viscosity solution of (P) when¬ 
ever / is uniformly continuous on an open and bounded set O C with Lipschitz boundary, 
and f{x) = 0 for X ^ O. In (TOj we extended this uniqueness result to the case where / is 
continuous on [0,oo)'’*, which allows the support of / to be non-compact. We expect unique¬ 
ness to hold under weaker regularity conditions on /. Figure [2] gives a visual illustration of 
Theorem [2j 

In the proof of Theorem [J] we assume the family of Poisson point processes is 

dehned on a common probability space and we apply deterministic PDF arguments to the 
individual realizations 

c/-(x) = ^(n-^n[o,x]). 
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(a) n = 50 points (b) n = 10"* points (c) n = 10® points 

Figure 2: Visualization of the continuum limit given by Theorem [2] applied to the distribution 
in Figured) In (b) and (c), we compare the Pareto fronts to the level sets of the viscosity 
solution of (P). 

In the literature on the longest chain problem, it is common to take a construction for which 
n f—)• U!^ is monotone nondecreasing for all realizations oj. Indeed, this was necessary to obtain 
almost sure convergence in some early works (see PIM]). Due to the sharp concentration of 
measure results established by Frieze [23], Bollobas and Brightwell |8|, and more recently by 
Talagrand |59| . the monotonicity property is no longer required for almost sure convergence. 
Thus, our proof of Theorem [2] does not assume any particular construction of (see 

Theorem [3|) . 

We should mention, however, that if we do construct a family of Poisson point processes 
{IIjjljgR^ on a common probability space in such a way that 

n^/ C IIjj whenever s < f, (2-3) 

then the function Ut{x) = i{^tf H [0,a;]) is monotone nondecreasing as a function of t S M_|_ 
for every realization. It then follows directly from Theorem [2] that 

t~dUt —> u locally uniformly on [0,oo)'^ 

with probability one as t —)• oo. One way to ensure that (12.3p is satisfied is to construct Htf 
via a generalization of (|2.1I) m- 

2.1 Informal derivation 

As motivation, let us give an informal derivation of the Hamilton-Jacobi PDF continuum limit 
(P). This derivation was originally given in a slightly different form in |llj . and our proof of 
Theorem [2] is based on these heuristics. Suppose / : ^ [0, oo) is continuous and that 

n~'^Un — > u G C'^(M'^) uniformly with probability one for some a G (0,1). The argument 
below not only derives (P), but also suggests the order of growth a = ^. 

Let X G (0, 00)*^. Since Un is nondecreasing, the uniform limit u must be nondecreasing and 
so Uxi(x) > 0 for all i. Let us assume that Ua,.(x) > 0 for all i. Fix v G with {Du{x),v) > 0 
and consider the quantity n'^{u{x + u) — u{x)). This is approximately the number of Pareto 
fronts passing between x and x + v when n is large. When counting these fronts, we may 
restrict ourselves to Poisson points falling in the set 

A=|yGM'^ : y ^ x + v and u{y) > u(x)}. (2.4) 
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Figure 3: Some quantities from the informal derivation of the Hamilton-Jacobi PDF (P). 


This is because any points in {y G : u{y) < u{x)} will be on previous Pareto fronts and 
only points that are coordinatewise less than x + v can influence the Pareto rank oi x + v. See 
Figure[3]for a depiction of this region and some quantities from the derivation. Since Ux^ (x) > 0 
for all i, and u is A is well approximated for small |u| by a simplex with orthogonal corner, 
and the points within A are approximately uniformly distributed. Let N = N{A) denote the 
number of Poisson points falling in A. Since we can scale the simplex into a standard simplex 
while preserving the Pareto fronts within A, it is reasonable to conjecture that the number of 
Pareto fronts within A (or the length of a longest chain in A) is asymptotic to ciA^" for some 
constant ci > 0, independent of x. 

By the law of large numbers, we have N ~ n fy^f{y)dy. Hence when |u| > 0 is small 


n°‘{u{x + u) — u{x)) 



f{y) dy^ 


cin“|Hr/(x)“, 


(2.5) 


where |H| denotes the Lebesgue measure of A. Let ii,... ,1^ denote the side lengths of the 
simplex A. Then |H| ~ C 2 ii - ■ ■ id for a constant C 2 . Since x + v — iiCi lies approximately on 
the tangent plane to the level set {y : u{y) = u{x)}, we see that 


{Du{x),v — iiSi) « 0. 

This gives ii Ri Uxi{x)~^{Du{x),v), and hence 

|H| Ri C2iuxi{x)~^ ■ ■ ■Ux^ix)~^){Du{x),v)'^. (2.6) 

For small 1^1, we can combine (|2.5I) and (|2.6I) to obtain 

{Du{x),v) Ri u{x + v)- u{x) Ri ciC2f{x)^{uxi{x)~°‘ ■ ■ ■ Uxj^{x)~°‘){Du{x) , . 


Therefore 

Ua;i(x)“ • • •Ua;^(x)" Ri C'/(x)"(L>tt(x),u)"'^"\ 

where C = cic^ • Since the left hand side is independent of v, this suggests that a = ^ and 

Uxi ■ ■ ■ Ux^ = C^f on 

Although this derivation is informal, it is straightforward and conveys the essence of the 
result. Inspecting the argument, we see that the main ingredients are an invariance with 
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respect to scaling along coordinate axes, and some basic properties of the coordinatewise 
partial order. It is intriguing that we can derive the order of growth nd and the continuum 
limit (P) from such basic information. This seems analogous to dimensional analysis arguments 
in applied mathematics, which use ideas like self-similarity and scaling to derive fundamental 
laws for natural phenomena [5]. A fundamental feature of dimensional analysis is that, like 
our argument above, it usually gives no information about the constants of proportionality. 
Contrary to dimensional analysis, which is typically nonrigorous, we show in this paper that 
the argument above can be made rigorous using the framework of viscosity solutions. 


2.2 Outline of proof 

Our new proof of Theorem[2]is a rigorous version of the heuristic dimensional analysis argument 
given in Section 12.11 The main ideas used in our proof draw some inspiration from the 
Barles-Souganidis framework for convergence of numerical schemes [6]. The Barles-Souganidis 
framework establishes convergence of any numerical scheme that is monotone, consistent, and 
stable, provided the PDE admits a strong comparison principle. In our proof of Theorem [2l 
we view Un as a numerical approximation of the viscostiy solution of (P), and use ideas that 
parallel monotonicity, stability and consistency to prove convergence to the viscosity solution 
of (P). 

The longest chain problem is monotone in the following sense: For any finite sets A,BC 

ACB ^ t{A) < 1{B). (2.7) 


When proving convergence of numerical schemes to viscosity solutions, monotonicity of the 
scheme is used to replace the numerical solution by a smooth test function for which consistency 
is trivial. The monotonicity property (12.7[) is used for precisely the same purpose in the proof 
of Theorem [2l though consistency is non-trivial in this setting. 

Stability of numerical schemes for PDE usually refers to a uniform bound on the numer¬ 
ical solutions that is independent of the grid resolution. Here, we use a type of asymptotic 
equicontinuity. Namely, in Theorem [J] we show that a bound of the form 

\Un{x)-Un{y)\<C\x-y\^iiA (2.8) 


holds for all x, y with probability one. The stability estimate (12.8j) and the monotonicity of 
Un can be combined with the Arzela-Ascoli theorem to show that for every realization w in a 

probability one event D, there exists a subsequence converging locally uniformly on 

[0, oo)'^ to a locally Holder-continuous function U‘^. 

The final step in the proof is to use consistency and monotonicity to identify U‘^ as the 
unique nondecreasing viscosity solution of (P). Our consistency result. Theorem [5l is a state¬ 
ment on the asymptotic length of a longest chain in sets resembling the approximate simplex 
(12.4p used in the heuristic derivation. Namely, for a smooth test function ip with ipxi > 0 for 
all i, we prove asymptotics of the form 


i{Ilnf n Ag) ~ 


/Cd / fix) 

\ipxAx) ■ ■ ■‘Pxaix) 


£ -|- O(e^) 


nd, 


as n —>■ oo, where 

Aeix) = |y e H(x, v^) : y Sx and ipiy) > ipix) - e|. 
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Notice the set A^(x) is similar to the set A used in the heuristic derivation and defined in 
()2.4p . The main difference is that A^{x) is defined using a smooth test function, and more 
importantly, it is defined by looking “backward” from the point x, instead of looking “forward” 
as in (12.4p . This respects the natural domain of dependence of the nondominated sorting 
problem, and allows us to use the monotonicity of I in the proof of Theorem [2l This is 
analogous to the idea of an upwind numerical scheme for Hamilton-Jacobi equations. 


3 Analysis of longest chain problem 


Let us give a brief history of the longest chain problem. Let Xi, ... ,Xn be i.i.d. random 
variables uniformly distributed on the unit hypercube [0,1]'^, and let = £({Xi,... ,Xn}) 
be the length of a longest chain. Hammersley |25j was the first to study the asymptotics of 
in, motivated by a connection to Ulam’s famous problem of finding the longest monotone 
subsequence in a random sequence of numbers |60) . Hammersley showed that in dimension 
d = 2, n~^in —>■ c > 0 in probability as re —)• oo, and he conjectured that c = 2. The value 
c = 2 was later established in |451I61) . Hammersley’s proof is now a classic application of 
subadditive ergodic theory. 

Bollobas and Winkler [9] extended Hammersley’s result to dimensions d> 3 showing that 
n~ d in ^ Cd > 0 in probability. They also established the bounds 


d^ 



<Cd<e, 


which by Stirling’s formula shows that lim(^_^oo Cd = e. Aside from C 2 = 2, the exact values of 
Cd are still unknown. When the random variables {^n}nGN defined on a common probability 
space in such a way that re i—is monotone nondecreasing along sample paths, the stronger 
almost sure convergence can be obtained via an observation of Kesten |34| . 

Here, we consider the longest chain among Poisson points. For t > 0 let 


Lt = iiUtn[o,i]'^). 


Then Lf has the same distribution as 

Lt = i{Uin[o,t-d]^). 

Notice that the family {Lt}t>o is defined on a common probability space and 1 1 —)• is mono¬ 
tone nondecreasing along sample paths. Subadditive ergodic theory |251I35) can be employed 
to show that 

_ i_— 

t dLt ^ Cd almost surely as t —)• oo. 

Since Lt and Lt merely have the same distribution, this argument only gives convergence in 
probability for Lf. 

Since we have made no assumptions about how the Poisson point process Unf is to be 
constructed, the proof of our main result (Theorem [2]) relies on establishing almost sure con¬ 
vergence for sequences of random variables that have the same distribution as Lt, but may 
not necessarily satisfy the monotonicity condition. Using the concentration of measure results 
provided by Talagrand’s isoperimetric theory |59| we can establish the following result. 
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Theorem 3. For t > 0, let Lt = i(Jit ^ [0,1]'^). Let {injnsN an increasing sequence of 
positive real numbers such that 


OO 

^exp 

n=l 



< OO 


for all e > 0 . 


(3.1) 


Then 

tn Lt^ —)> Cd completely as n —)• oo. 


Recall that a sequence of random variables Xi,X 2 , ■ ■ ■, X^, ■ ■ ■ converges completely to a 
random variable X if 

CX) 

P{\Xn — X| > e) < OO for all e > 0 . 

n=l 

By the Borel-Cantelli lemma, complete convergence implies almost sure convergence. The 
advantage of complete convergence is that it depends only on the distributions of Xn and X, 
and not on any particular construction of the random variables. We believe Theorem [3] is 
likely well-known in the probability literature, but to the best of our knowledge it has not 
been published. For the sake of completeness, we have sketched the proof of Theorem [3] in the 
appendix. 


3.1 Stability 

In this section, we prove in Theorem 0] a stability result for the longest chain problem. We 
first have a preliminary lemma. 

Lemma 1. Let f & B, and define Un by (12.2h . Then for any x,y ^ [0, oo)'^ 

limsupn"^(C/„(x) - Un{y)) < CddMV||/||d^ |x - y\i ( 3 . 2 ) 

n—>-oo ^ 

with probability one, where M = maxjxi, yi, X 2 , 2 / 2 , • • • j Xd, Vd}- 
Proof. We first show that 

Urn sup n~^Un{x + hci) - Unix)) < c^M V ( 3 . 3 ) 

for all /i > 0 and i G {1,... ,d}. Without loss of generality we may assume that i = 1. If 
Xj = 0 for some j > 2, then x,x + hei G and hence Unix) = Unix + hei) = 0 with 

probability one. Thus, we may assume that Xj > 0 for all j > 2. 

Let L = Unix + hei) let C = {Xi,... ,X]^} be a chain in H [0, x + hei] of length 
L. We can split this chain into two chains, Ci and C 2 , such that Ci lies in the rectangle [0, x], 
and C 2 belongs exclusively to R := [xiei,x -|- hei]. See Figure 0]for a depiction of the setup. 
By the definition of Un 


Unix + hei) = KCl) + KC2) < Unix) + lillnf H R). 


Let K = sup^ / and set 


9ix) 


K-fix), 

0 , 


(3.4) 
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if X G i? 
otherwise. 



Figure 4: A depiction of the chains Ci and C 2 from the proof of Lemma [T] 


Let Ting he a Poisson point process with intensity ng and let LI = U ling- Then IT is a 
Poisson point process with intensity A, where 


A(x) = nf{x) + ng{x) 


nK, if X € R 
nf{x), otherwise. 


Let N = / 1 X 2 X 3 • • • XdKn. By scaling, ^(II H R) has the same distribution as ^(IlAr H [0,1]'^). 
By Theorem [3] and the inclusion Unf C 11 we have 


lim sup n 

n—^oo 


U{U, 


'«/ 


n R) < lim n 

n—>-oo 


d£(Il n i?) = Cfi(x2 ■ 


1 i , i d-l 1 1 

XdjdKdfld ^ C^M d KdJld 


with probability one. Combining this with fl3.4p establishes (13.3h . 

We can apply (13.31) in each coordinate and note that ~ — 2 /|^ to 

establish the desired result (lO) . □ 


Recall that f* and /* denote the upper and lower semicontinuous envelopes of /, respec¬ 
tively, defined by 

f*{x) = limsup/(y), 


y^x 


and /* = -(-/)*. 


Theorem 4 (Stability). Let f ^ B, and define Un by (|2.2I) . 

limsupn"^(C/„(x) - C 4 (y)) < CddM^\\f*\ 

n^oo 


Then with probability one 
1 1 


(3.5) 


for all x,y e [ 0 , 00 )“^, where M = max{xi, yi, X 2 , ^ 2 , ■ ■ ■,Xd,yd}- 

It is important to emphasize in Theorem |4] that (13.51) holds with probability one simulta¬ 
neously for all x,y £ [0, oo)'^. This is a far stronger statement than Lemma [T] where it was 
shown that for fixed x,y £ [0, 00 )*^, (|3.5I) holds with probability one. This stronger result gives 
us a form of compactness that is used in the proof of Theorem [2j 
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Figure 5: Illustration of the simplex Sx 


Proof. For x,y ^ [0, oo)*^ let 0,x^y denote the event that (|3.2I) holds for x, y. By Lemma [H 
= 1- Let 

0 = G n [0,oo)'^|. 

Being the countable intersection of probability one events, fl has probability one. 

Let X, y G [0, oo)'^. Let x, y G H [0, oo)*^ such that x ^ x and y ^ y, and set 

M = max{xi, yi, X 2 , y 2 , ■ ■ ■ ,Xd, yd}- 

Then since Un is nondecreasing 

Unix) - Uniy) < Unix) - Uniy), 

and therefore 

L^supn-^([/;;’(x) - U^iy)) < qcImV- y|H for all ujGQ. 

Since we can choose x and y arbitrarily close to x and y, respectively, we obtain 

limsupn"3(17“(x) - Uniy)) < CddM^j^.^Ax - y\^ for all w G fl, 
which completes the proof. □ 


3.2 Consistency 

We now establish our main consistency result. For x, x G (0, oo)“*, we define 

Sx,v = G : z^x and (x — z,v) <1^. (3-6) 

The set Sx^v is a simplex with orthogonal corner at x and side lengths 1/xi,..., l/vd- See 
Figure [5]for an illustration of Sx^v We also define 1 = (1,... , 1) G M'^. 

Lemma 2. Let x,v £ (0,oo)'^ and let {tnjneN be any inereasing sequence of positive real 
numbers satisfying (13.ip . Then 

Cd 


lim tn'^i (nt„ n Sx,v) = - 1 

divi---Vd)d' 


(3.7) 


in the sense of complete eonvergence. 
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Proof. We first show that 


— — Crf 

lim n S'! i) = — completely. 

n^oo ’ a 

Note that we can write 

•S’!,! = |x e [0,1]'^ : xi H-h Xd > d - l|. 

Let iL be a positive integer and define 


(3.8) 


It follows from this construction that every chain in is contained entirely in [x, 1] for some 
X G /. Since / is a finite set 

£ (Hi n 5i^i)) < max (lit n [x, 1]) : x G/|. (3-9) 

Fix X G / and let = tn nti(i — Xj). Since Fl [x, 1]) has the same distribution as 

F [0, l]*^) we have by Theorem [3] that 


lim F [x,l]) 


CdHil - Xi)-d < ^ ^(1 - Xi) = Cd Q + 

7 — 1 7 — 1 '' 


in the sense of complete convergence. Combining this with (13.9p and noting that K was 
arbitrary yields 

limsuptnFS"!,!)) < ^ (3.10) 

n^oo CL 

completely. 

For the other direction, let z = l{d — l)/d. By Theorem [3] 


lim inf tn (!!*„ F Si^i) > lim tn F 1]) = Cd ]T(1 - Zj) ^ 

n—^oo n—^oo d 

i=l 

in the sense of complete convergence. This establishes (|3.8p . 

We now establish (j3.7p with a simple scaling argument. Let x,u G (0, oo)'^ and define 
<I> : by 


^(y) = (( 2/1 - Xi)vi + 1 , (y 2 - X 2 )X 2 + 1,... , (yd - Xd)vd + 1) . 

Since Vi > 0 for all i, the mapping <I> preserves the partial order ^ and therefore 

n 5,,,) = i (^>(ni„ n 3^,^)) • (3.ii) 

Let n be the Poisson point process induced by the mapping i.e., 11 = <I>(nn). Then LI is a 
Poisson point process on with constant intensity Nn = tn/(xi • • • Vd). Since ^{Sx,v) = 5'i,i, 
we have by (13.lip that iijltn P'Sx^v) and H S*!,!) have the same distribution. The result 

now follows directly from (13. 8 p . □ 
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Lemma 3. Let f & B. Then for any x,v £ (0, oo)'^ 


r ^ / Cd /^sup 5 /y 

hmsupn <^1 [Unf n Sx,v) < ^ [ -^— 

n^oo d \Vi---Vd J 


and 

liminfre“d£(n„/ fl Sx,v) > % (— 

n^oo d \Vi ■ ■ ■ Vd J 

with probability one. 

Proof. Let x,v £ (0, 00 )*^, K = sup 5 ^ ^ /, and define 


9{x) 


K - f{x), if X £ Sx,v 
0 , otherwise. 


(3.12) 


(3.13) 


Let Ylng be a Poisson point process with intensity ng and let 11 = U^f U ling- Then IT is a 
Poisson point process with intensity A, where 


X{x) = nf{x) + ng{x) 


nK, if X € Sx,v 
nf(x), otherwise. 


By Lemma [2] 

lim {Kn)--dl (n n 5^ ^) =- - -j- 

’ d{vi ■ ■ ■Vd)d 

with probability one, and hence 


lim n di {II D Sx v) 

rx—>-OD ’ 


cd / supg^„/ y 

d \vi---Vd J 


with probability one. Since Unj ^ H, £ (n„y n Sx^v) < ^ (H n Sx,v): which establishes (|3.12l) . 

To prove (I3.13p . note first that if infg^ „ / = 0, then the result is trivial. Hence, we may take 
m := inf 5 ^ „ / > 0. For each point X from If^f that falls in Sx^v^ color X red with probability 
m/f{X). The red points form another Poisson point process on Sx^v with intensity mn |36| . 
Let us denote this Poisson point process by H'’. By Lemma [2l we have that 


lim (mn) (H’’n S’a, .y) =- - -j- with probability one. (3-14) 

’ d{vi - ■ ■Vd)d 

Since H*^’ C Unf, (.{IT H Sx^v) < ((Tnf H Sx,v)- Combining this with (|3.14p completes the 
proof. □ 


Lemma 4. Let f £ B. Then with probability one 

limsupn“3^(n„/n 5^;,^) < ^ ^ (3.15) 

n-^oo d \ Vi - ■ - Vd J 

and 

1 

liminf n~d( {Unf n Sx,v) > ^ ^ (3.16) 

n^oo d \ Vi ■ ■ ■ Vd J 

for all x,v £ (0, 00 )^. 
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Proof. Let us prove (13.151) : the proof of (|3.16p is similar. For each x,v G ( 0 , 00 )“^ let Qx,v 
denote the event that (j3.12p holds for x,v. By Lemma [3l = 1. Let us set 


: X, u € n (0, oo)'^|. 

Being the countable intersection of probability one events, has probability one. 

Let x,v G (0, 00 )*^ and let w G fl. Let q G (0, oo)'^ n such that Qi < Vi for all i, and let 
y G (0, 00 )*^ n Q'^ such that y ^ x and 


J_ ^ ^ + {y-x,v) 

(Ij ~ 

We claim that Sx,v C Sy^q. To see this, let z G Sx,v and write 


(3.17) 


13^ {y-Z,v) {x-z,v) + {y-x,v) 

s ! + ! + (!,-.,„> SI- 

where we used in the last step that {x — z,v) < 1. Therefore z G Sy^q. It follows that 
(.{Jlnj n Sx^v) < ^(n„/ n Sy^q), and from (I3.12P we deduce 

limsupn~s^ n Sx,v) < ^ f ■ (3-18) 

n^oo ■' d \qi---qd J 

Sending y —)• x in such a way that y ^ x and y G H (0, 00 )'^ yields 

r -iWTTO. ^ c- ^ / Cd fSUPs^ J*Y 

hmsupn dim r n Sx,v) <-7 [ - 

n^oo ■' d \ qi---qd J 

The result follows by noting that the limit above holds for all q G (0, oo)'^ n with q^ < Vi 
for all i. □ 


We denote by B[x, r) the open ball of radius r > 0 centered at x G We now prove our 
main consistency result. 

Theorem 5 (Consistency). Let f G B. Then with probability one 


limsuphmsupe“^n“^^(n„f n ^p(xn)) < — I , , , , 

,^0+ n^oo ^ ^ ^ - d YxYo) ■ ■ ■ Tx.ixo) 


f*{xo) 


(3.19) 


and 


liminfliminfe“^n~5.£(n^rn^£(xo) > — , 

£^■0+ d \ipxi[xo) ■ ■ ■ ipxaixo) 

for all xq G (0, oo)*^ and all ip G C'^(M'^) such that pxi{xo) > 0 for all i, where 


f*{xo) 


(3.20) 


^^(xo) := |x G B{xo, y/e) ■ x ^ xq and p{x) > p(xo) — e|. 


(3.21) 
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Proof. Let Q be the event that (|3.15p and (|3.16p hold for all x,v £ (0,oo)'^. By Lemma U Q 
has probability one. Let xq G (0, oo)'^, e > 0 and let ip G (7^(0) such that ^px^{xo) > 0 for all 
i. Fix uj £ n. 

We will give the proof of (13.191) : the proof of (13.201) is very similar. Since ipx^(xQ) > 0, there 
exists m > 0 such that ipx^{x) > m for all x £ i £ {1 ,... , d}, and all e > 0 sufficiently 
small, ft follows that for any x £ 


ip{xQ) - ip{x) = / {Dip{x + t{xo - x)),xo - x) dt>m - Xj) > 


m\XQ — x\ 


2 = 1 


y/d 


We therefore deduce 


\xo — for all x £ A,, 

m 


Since ip £ C'^, there exists a constant C > 0 such that 

ip{x) - ip{xo) < {Dip{xo),x - xq) + Ce^ 


(3.22) 

(3.23) 

(3.24) 


for all X £ A^ and e > 0 sufficiently small, ft follows that 

As{xq) C |x G : X ^ Xq and {Dip{xQ),XQ — x) < e + 
Setting = Dip{xQ)/{e + Ce^) we have ^^(xo) C Sx^^q^, and hence 

i{KfnA,{xo))<iiu‘ffnSxq,q,). 

By (HTT^ 


limsupn n ^e(xo)) < 


Sending e ^ 0'*' completes the proof. 


Cd / sup5^ 


r_\ 


d I v^a:i(a;o) • • • Pxaixo) I 


(e + Ce^). 


□ 


4 Proof of main result 


We now have the proof of Theorem [2j 


Proof. Let fl denote the event that the conclusions of Theorem 0] and Theorem [5] hold, and 
= 0 on for all n. Then P(0) = 1. Let us fix a realization w G tl. The remainder of 
the proof is split into several steps. 

1. We first use stability (Theorem 0|) to obtain a compactness result. Since U^{0) = 0 
for all n, it follows from Theorem 0] that the sequence {n“'5C/^(x)}^gj,^ is bounded for all 
X G [0, oo)'^. By a diagonal argument, there exists a subsequence such that for all 

_ j. 

XG [0,oo)'^nQ'^, {n,^'^U!;f^{x)}^^^ is a convergent sequence, whose limit we denote by U^{x). 
By Theorem 0] 


P^^ix) -U‘^{y)\= lim |C/“ (x) - 


rife—)-oo 


nk 


iy)\ < CddM'^d 




\x-y\d (4.1) 
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for all x,y G [0, oo)'^, where M = max{xi, ?/i, X 2 ,2/2; • • • il/d}- Hence, we can extend 
uniquely to a function G C'([0,oo)'^) such that for every M > 0, G ([0, M]'^) 

and 




< CddM d 


II f*\\ 

11 -' iIl°°([o,m]‘^)' 


(4.2) 


Furthermore, is nondecreasing and U‘^ = 0 on 
_ 

We claim that —)• U‘^ locally uniformly on [0, 00 )'^. The proof of this is similar 

to El Theorem 1], We include it here for completeness. Fix M >0 and let e > 0. Let T G N 
and for any multi-index a G let Xa = a/T. Let I be the set of multi-indices a G for 
which Xa G [0, MY- Since is continuous on [0, M]'^, we can choose T large enough so that 


U‘^{xa+i) — U^{xa) < e for all a & I. 
Since I is a finite set and x„ G for all a G /, we deduce 


(4.3) 


lim max 

/c—)-oo aGl 


n,~^UYY^a)-U^{Xa) 


= 0 . 


(4.4) 


Let y G [0, and let a G / such that Xa = y = Xa+i- Since and are nondecreasing 
we have 

1 1 I I4.3D 1 

n~^UY{y)-U^{y) <n~dUY{xa+-i)-U^{xa) < n~dUY{xa+i)-U‘^{xa+i)+e. 


Similarly, we deduce 


n dUY[y) -U‘^[y) >n dUY[xa) -U‘^iXa+l)^ n dJJYiXa) -U'^iXa) - £■ 


Combining these inequalities yields 


n 


-dUY-U^\ 


d[ 0 ,M]<i) < max 


n dUn{Xa) -U^{Xa) 


+ s. 


(4.5) 


Invoking (|4.4p we see that 

lim sup ||n^ - U^\\L^{^yo^M]d) < 

k^oo 

Sending e —)• 0 establishes the claim. 

2. We now show that U‘^ is a viscosity subsolution of (P). For simplicity, let us set 

Vk = nf^UY, and V = . 

Fix M > 0 and let xq G (0, M)'^. Let ip G C'^(M'^) such that V — (p has a local maximum at xq. 
Since V is nondecreasing, pxiixo) ^ 0 for all i. If pxi{xo) = 0 for some i, then the subsolution 
property is trivially satisfied. Hence, we may assume that pxi{xo) > 0 for all i. Without loss 
of generality, we may also assume that V — p has a strict maximum at xq, relative to the set 
[0, M]'^. Then there exists a sequence {xfcjfcgH in [0, M]'^ converging to xq such that Vk — p 
has a maximum at Xfc, relative to [0, M]'^. 
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Let r,m > 0 such that B{xQ,r) C (0,M)'^ and ^px^{x) > m for all x G B[xQ,r) and all i. 
Let e G (0,1) such that 


w? 2 
e < min < —r, r 
' 4d 


(4.6) 


Since ^ V uniformly on [0, M]'^ and —)• xq, there exists K > 0 such that for all fc > iL 

(p{xo) - ifixk) + Vk{xk) - Vk{xo) < e^. (4.7) 

Let 


= {z G [0,xo] : Vk{z) > Vk{xo) - s}. 


(4.8) 


We claim that Ak,£ C B(xQ,y/e) for all k > K. To see this, let z G B{xQ,r) such that 
z ^ xq and note that 


mlxn — z\ 

(p{xo) - (fiiz) = / {Dip{z + t{xo - z)),xo - z) dt>m V(xo,i - Zi) > - -= -. 

Jo Vd 

Since Vk — (f has a maximum at Xfc, 

Vk{z) - tp{z) < Vk{xk) - ip{xk) for z G [0, . 

Combining this with (14.6p . (|4.7I) and (|4.9D we deduce 


(4.9) 


(4.10) 


Vk{z) < Vk{xk) + ^{z) - ip{xk) 

= Vfc(xo) + (p{z) - ip{xo) + (p{xo) - ip{Xk) + 14(Xfc) - 14(xo) 

< 14(3:0) - + 

< 14(3:0) - e 

for all z G dB{xo, ^/£) with 2 : 4 xq, and k > K. Since I 4 is nondecreasing, Ak,£ 4 B{xq, y/e), 
establishing the claim. 

We now claim that 

en| <£(n-^^nA,.). (4.11) 

To see this, since Un is integer valued, we can write Ak^e as 

Ak,e = {zG [0,xo] : f/^,(z) > U^^ixo) - [enl\], (4.12) 

where [tj is the largest integer less than or equal to t G M. Since Ak,£ 4 B{xo,r) C (0, 00 )'^ 

1 

and Unf,{y) = 0 for y G we must have that U^^{xo) — > 1. Let L = U^^{xo) 

and let Xf 4 • • • 4 be a chain in n [0,Xo] of length L. For any q > L — [en^J, 
Un,,{Xq) > q > L — and hence G Ak,£- Hence the chain X'^,... belongs to 

Ak,£ for q = L — [en^J and 

enl < [enl\ + l = L-q + l< n Ak,e), 
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which establishes the claim. 
By (14.71) and (|4.10p 


Vk{z) - 14(xo) < ^{z) - ipixo) + 

for all A; > K and z G [ 0 , M]*^. Since Ak^e C B{xo,y/e) it follows that 

C {z G B{xo, y/e) ■. x^xo and ^p{z) > <y9(xo) - e - e^)] =: A^j^^ 2 {xq) (4.13) 

for k > K, where A^_^_^ 2 {xq) is dehned as in Theorem [5l Invoking (14.111) and the monotonicity 
of i we have 

-1 1 

£ < limsupn^ n Ak,e) < limsupn“d£ {^nf ^ ^e+e^i^o)) ■ 

fe—J-CXD n—>-oo 

Since Theorem [5] holds for all a; G 11 and yjj;.( xq) > 0, we deduce 

1 < limsuplimsup(e + A^,^ 2 {xq)) < ^ f -7— ^ —7—r ) , 

£^0 n^oo \ nj e+e y ^ V T'xi (xq) ' ' ' (^o) / 

and hence 

(-^d 

^xAxo) ■ ■ ■ ^xaixo) < -^f*{xo). 

3. We now show that 17 is a viscosity supersolution of (P). Let y? G such that V — ip 

has a local minimum at xq. Without loss of generality, we may assume that xq is a minimum 
oiV — if relative to the set [0, M]'^. Since 17 is nondecreasing, ^px^ (xq) > 0 for all i. For A > 0, 
set 

p>^{x) = p>{x) + A(xi H-h Xd)- 

Then V — has a strict minimum at xq, relative to the set [0, xq], and p^,{xq) > 0 for all i. 
Therefore, there exists a sequence {xfcjfceN in [Oj^^o] converging to xq such that Vk — has a 
minimum at x^, relative to [ 0 , xq]. 

Let r,m > 0 such that B{xQ,r) C (0,M)'^ and Px.{x) > m for all x G B{xo,r) and all i. 
Let e > 0 and let Xf ,..., X'j be a chain in ^ •^k,e- Then by the dehnition of Ak^e (I4.12p 

[/-(xn > - Lsnfj, 


and therefore 

U^,{xo) > (^r) ^ W) + J - 1 > U^.ixo) - [enl\ + j - 1. 

Hence j < en^ + 1 and therefore 

l{I['^^^^{Ak,e)) < enl + 1. (4.14) 

Since Vk — p^ has a minimum at x^ 

Vkiz) - Vk{xo) > p^{z) - p^{xo) + p^{xq) - p^{xk) + 17fc(xfe) - 17fc(xo), 
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for 2 : G [0,Xo]- Since —)• Xq and ^ V locally uniformly, we can choose k larger, if 

necessary, so that 

Vk{z) - Vkixo) > ip^{z) - <f^{xo) - for all 2 ; G [ 0 , 3 : 0 ]. 


It follows that 


•^k,e ^ {z & B{xQ,y/e) : X ^ xq and (p^(z) > (fi^(xo) + — e} =: A^_^ 2 {xo), 


where A^_^ 2 (xo) is as defined in Theorem [5j Invoking (I4.14p and the monotonicity of £ 

s4 + i>i n Ak,e) > £iK,f n a,_, 2 {xo)), 


and therefore 

e > liminf n A^_^ 2 {xo)). 

n^oo •’ 

Since Theorem |S] holds for all a; G n and (xq) > 0 


1 > liminf liminf(e — e^) d.£{Ji^r n A^_^ 2 {xo)) > ^ 

£—>■0 n—>-oo •' a 


f f*{xo) \ 
\<fxiixo)---V’x,ixo)) 


Thus, we arrive at 

i^xiixo) + A) • • • i^xai^o) + A) > -^f*ixo). 

Since A > 0 was arbitrary, 1^ is a viscosity supersolution of (P). 

4. By uniqueness of nondecreasing viscosity solutions of (P), we have = u. Since we can 
apply the same argument to any subsequence of {n~dU!^}n, and extract a further subsequence 
converging locally uniformly to u, we find that n~dU^ —)• u locally uniformly on [0, 00 )'^ for 
all a; G n, where has probability one. □ 


A Complete convergence for longest chain problem 


We sketch the proof of Theorem [3l 


Proof. Let e > 0. Let Xi, X 2 , X 3 ,... be a sequence of independent and uniformly distributed 
random variables on [0, l]'^ and let in = i{{Xi ,..., Xn}) be the length of a longest chain. Let 
N denote the cardinality of 11* n [0,1]*^. Conditioned on N = n, Lt and in have the same 
distribution, so by the usual tail bounds on Poisson random variables we deduce 


P(i, > A) < P j > a) + exp . 

BylSl there exist constants 0 < Ci < C 2 such that 

Cind < 'Kyin] < C2nd 

for all n > 1, and 

lim n~dE,[in] = Cd > 0. 

n—)-oo 


(A.l) 


(A.2) 

(A.3) 
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Since the longest chain function ^ is a configuration function (see |59l Definition 7.1.7]), we 
have 

P {in < M[4] - X), p {in > M[4] + A) < 2 exp (- ^ ) , (A.4) 

for any A > 0, where M(^„) denotes any median of in- A short computation involving ()A.2I1 
and (jA.4p yields 

|E[4] -M(4)| < Clog(n)n^. (A.5) 

and we find that n“dM[£„] —)• as n —>■ oo. Fix T large enough so that 

|M[£„] — for all n > T. (A. 6 ) 

It is well known (see, e.g., [58]) that 

\E[in]-nik]\<C\n-k\l 
Combining this with (IA.5P we deduce 

|M[£„] — M[.£fc]| < C (log{k)k'^ + log(n)nM — k\d'^ . (A.7) 

Recalling (lA.ip . (IA.4p and flA.bp we have 

P{Lt > Cdtd + etd) < 2exp + exp • (^- 8 ) 

for all f > T sufficiently large. The other inequality is similar, and the result follows from 

(lOl . □ 
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